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Abstract. We introduce an information heat engine that is autonomous (i.e., 
without any time-dependent parameter) but has separated measurement and feedback 
processes. This model serves as a bridge between different types of information heat 
engines inspired by Maxwell’s demon; from the original Szilard-engine type systems 
to the autonomous demonic setups. By analyzing our model on the basis of a general 
framework introduced in our previous paper [N. Shiraishi and T. Sagawa, Phys. Rev. E 
91 , 012130 (2015).], we clarify the role of the separation of measurement and feedback 
in the integral fluctuation theorems. 


1. Introduction 

“Maxwell’s demon” is a thought experiment proposed by J. C. Maxwell [1]: if 
a thermodynamic system is subjected to feedback control at the level of thermal 
fluctuations, the second law can be apparently violated. A prominent example is the 
Szilard engine [2] , which is a composite system of an engine and a memory. The memory 
measures the state of the engine and performs feedback to the engine. The feedback 
procedure allows positive work to be extracted from the engine through an isothermal 
cyclic process, which, under the usual circumstance, is prohibited by the second law 
of thermodynamics. Szilard characterized the two separated steps of measurement 
and feedback as the processes which change the extent of the correlation between the 
engine and the memory, and suggested the possibility of an extended framework of 
thermodynamics for systems with the change in correlation. The consistency of the 
second law of thermodynamics with the existence of Maxwell’s demon has been discussed 
vigorously [3]. It has been suggested that the key to understand the consistency is the 
change in the volume of the phase space |1], which characterizes the thermodynamic 
irreversibility |5]. Modern theories have revealed that this property is captured by 
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the mutual information, which is a quantity that measures the correlation between 
the engine and the memory. The generalized thermodynamic relations with the 
mutual information has been discussed for a single feedback process , continuous 
feedback processes [HHIQ], feedback cooling [nHl3], and more general information 
processing [HHiE]. 

Although these information-theoretic frameworks are expected to be useful in 
various problems in small fluctuating systems such as biochemical sensing HHIIH] 
and quantum mesoscopic systems [iniEn], there is a critical remark to be made; 
the original framework, which is applicable to the Szilard-type demons with step- 
by-step separated measurement and feedback processes, cannot be directly applied 
to autonomous stochastic information processes. This is because the processes of 
measurement and feedback can themselves occur stochastically at any time, and thus 
they are inseparable in autonomous setups. In purpose to extend the applicability of 
information thermodynamics to autonomous Maxwell’s demons, intensive researches 
on the model of autonomous demons [201123] and information flow [2H1M] have been 
recently made. Autonomous demons can be modeled as bipartite Markovian systems 
where the measurement and the feedback processes are not, in general, separated. The 
integral fluctuation theorem (IFT) obtained for the autonomous demons has distinct 
features from the relation obtained for the Szilard-type systems [T5l[T6]. The crucial 
difference comes from the fact that in the Szilard-type systems, the state of the engine 
(memory) is hxed externally during the measurement (feedback) phase, whereas in 
autonomous demons, it is not. 

In this paper, we clarify the difference between Szilard-type demons and 
autonomous demons on the basis of a general framework introduced in our previous 
paper [3l]. In purpose to build a bridge between these two different setups, we 
propose a new model of Maxwell’s demon, which is autonomous but possesses separated 
measurement and feedback processes. The key ingredient in the model is an additional 
stochastic variable, which plays a role of separating the measurement phase and the 
feedback phase. An IFT with the mutual information can be derived for this model, 
which is more similar to another IFT satished in Szilard-engine type demons [TSlflG] 
than to that for autonomous bipartite demons [34] . 

This paper is organized as follows. In Sec. [21 we review IFTs for Szilard-type demons 
and autonomous demons, where the mutual information plays a crucial role. We also 
discuss a general framework that leads to IFT of autonomous and non-autonomous 
demons in a unihed way, on the basis of the concept of the partial entropy production. 
In Sec. [HI we introduce a model of the autonomous demon with separated measurement 
and feedback phases, and derive an IFT for this model. On the basis of these discussions, 
in Sec. [H we elucidate the role played by the separation of the measurement phase and 
the feedback phase. 
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2.1. Thermodynamics of small systems 


Throughout this paper, we consider Markov jump processes during the time interval 
0 < t < T. The system is in the isothermal condition with inverse temperature /3, and 
the possible states of the system are denoted as . The transition from w' to 

w is written as w' —)■ w, where the transition rate at time t is denoted by P{w' —)■ w;t). 
We assume that for any states w and any time t there exists another state w’ such that 
P{w’ w]t) 7^ 0. The time evolution of the system is written as the master equation: 


dP{w, t) 
dt 


= J{w, t) := ^ J{w' w;t), 


( 1 ) 


where P{w,t) is the probability distribution of w at time t, and J{w' —)■ w,t) : = 
P{w',t)P{w' w;t) — P{w,t)P{w —)■ w';t) represents the probability flux from w' to 


w. 


Jumps between states occur stochastically in each trajectory, where we denote 
the number of jumps by N. The Tth jump occurs at time ti [1 < i < N), and 
correspondingly the state changes from Wi_i to Wi. We write the initial and flnal time 
of the entire dynamics as to := 0 and t^+i ■= T. The state at time t is written as w(t). 
We deflne the total entropy production atot as [35] 

N 

0-tot := - -)■ WiiU) + s{w{T),T) - s{w{0),0), (2) 

i=l 


where 


Q{w' —)■ w; t) 


1 ^ 

ft \P{w W'] t) J 


(3) 


is the heat absorption by the system from the heat bath with the transition w' ^ w at 
time t, and s{w, t) := — \nP{w, t) represents the stochastic Shannon entropy at the state 
w and time t. Here, we assumed the local detailed balance condition [36], and normalized 
the Boltzmann constant ks to 1. The total entropy production characterizes the 
irreversibility, and satisfles the IFT = 1 and the second law of thermodynamics 

(o-tot) > 0 [37fH0] . where (■) represents the ensemble average over all trajectories. 


2.2. General framework 

We now describe a general theoretical framework introduced in Ref. [3l], which is 
applicable to both Szilard-type and autonomous demons in a unifled way, as discussed 
in the subsequent subsections. Under this framework, the entropy production for the 
total system is divided into contributions from subsets of individual transitions, where 
each partial entropy production satisfles an IFT. 

We divide a set of all possible transitions w’’ —)■ into two subsets: and its 

complement In Fig. Hl^a), for example, the six red arrows represent the transitions 
included in H and the other sixteen black arrows represent the transitions included in 
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Figure 1. (a): An example of the choice of il. The six red arrows correspond to 
transitions in 17. (b): A schematic of a time-series of the stochastic Shannon entropy 
along a single trajectory. The initial state is w'^, and the jumps and —>■ w'^ 

occur at times ti and t 2 , respectively. The dashed lines represent the change in the 
stochastic Shannon entropy induced by the jumps, and the solid lines represent that 
induced by the change in the probability distribution. 


We divide the total entropy production atot into the contributions from hi and which 
are denoted by uq and cxnc, respectively. Note that the subset hi can be time-dependent 
in general. 

First, we divide the probability flux at the state w as J{w, t) = Jn{w, t) -f Jqc^w, t), 
where is defined as 

Jn{w,t) := J{w'^W]t) (4) 

and Jqc[w, t) is defined in the same manner. Using Eq. (|lj), we define the partial entropy 
production as |3l] 

an := -(dQn + As^. (5) 


The hrst term of the right-hand side (rhs) of Eq. ([5]) represents the heat absorption 
accompanied by the transitions in hi: 

N 

Qn ■= U)dn{wi-i -)■ Wi), ( 6 ) 

i=l 

where 6q{w' —)■ w) takes 1 if {w' —)■ w) G and takes 0 otherwise. The second term 
of the rhs of Eq. Q represents the change in the stochastic entropy induced by the 
transitions in hi: 


Asq := sn. 


Jn{w{t),t) 


jump 


dt. 


The hrst term of the rhs of Eq. 

N 


P{w{t),t) 
is dehned as 


(7) 


Sojump := ~ ti)) dn{wi-i -7 Wi), (8) 

i=l 

which quantihes the contributions from jumps (dashed lines in Fig. [T](b)) within hi. The 
second term of the rhs of Eq. ([7]) evaluates the change induced by the probability hux 
(the solid lines in Fig. [11(b)) within hi, which is conhrmed by 

ds{w,t) _ Id _ Jn{w,t) _ Jnc{w,t) 

P{w,t) P{w,t) 


dt 


P{w, t) dt 


(9) 
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Figure 2. Repeated measurement and feedback processes. The dashed lines indicate 
frozen phases and the red bold lines indicate movable phases. 


It is crucial that the partial entropy production ctq satisfies 

Co + o'nc = CTtot 5 (10) 

and the IFT [M] : 

= 1 . ( 11 ) 

Applying Jensen’s inequality to Eq. Dll. we obtain 

(co) > 0. (12) 

In the following two subsections, we show two IFTs for Szilard-type demons 11181) and 
that for autonomous demons ll20|) which are particular cases of Eq. flTT|) . 

2.3. IFT for the Szilard-type demon 

In this and the next subsections, we consider a bipartite system that consists of 
subsystems X and Y, where the state is written as w = {x,y), with the transition 
rates satisfying P{{x,y) — )■ {x',y');t) = 0 for x ^ x' and y ^ y' . We dehne the entropy 
production of subsystem X as 

(Tx '■= —fdQx + Asx, (13) 

where Qx is the heat absorbed by subsystem X, and Xsx '■= — lnP(x(T),T) -|- 
lnF(a;(0),0) is the change in the stochastic Shannon entropy of only x. In contrast 
to the averaged entropy production of the total system (cxtot), that of the subsystem 
{ax) can be negative. In the case of the Szilard engine [2], which is a composite system 
of an engine and a memory, the entropy production of the engine is negative on average 
corresponding to the extraction of work from the isothermal cycle. 

In previous works [l5l|T6], it has been discussed that modihed IFT and second law 
still hold under these setups, if the change in the correlation between the engine and 
the memory is taken into account. In the case of the Szilard engine, the measurement 
process increases the correlation, and the feedback process decreases the correlation. In 
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Figure 3. The choice of 17 in the proof of the IFT for Szilard-type demons dT51) . 


general, the correlation is quantified by the mutual information. The stochastic mutual 
information between the state of the engine X and the state of the memory Y is defined 
as 


h{x;y) : = 
whose ensemble average 


, P{x,y,t) 
P{x,t)P{y,ty 


(14) 


{It{x]y)) = J2P{x,y,t)hi 

x,y 


P{x,y,t) 

P{x,t)P{y,t) 


(15) 


is the mutual information [H]. The mutual information is zero if there is no correlation, 
and becomes larger if the correlation is stronger. 

In order to generalize the setup of the Szilard engine, we here suppose that there 
are m-times of measurement and feedback processes in a composite system of X and Y 
during the time interval from Tq = 0 to T 2 m,- During the time interval T 2 n < t < T 2 n+i 
(T 2 n+i < t < T 2 n+ 2 ) with 0 < n < m — 1, only Y (X) can evolve and X (Y) is fixed 
(see Fig. E]), corresponding to the measurement (feedback) phase. These conditions are 
written as 


P{x^ x'\ 1/, t) = 0 {T 2 n < t < Tan+i) , (16) 

P{y -)■ y; x,t) =0 {T 2 n+i <t < T 2 n+ 2 ), (17) 

where we abbreviated the transition rates as P{x — )■ x';y,t) := P{{x,y) — )■ {x',y);t) 
and P{y —)■ y';x,t) := P{{x,y) —)■ {x,y')-,t). This setup represents the repeated 
measurement and feedback processes between the engine X and the memory Y. Here, 
by applying Eq. (1TT|1 with setting all transitions in X as D (see Fig. [3]), the entropy 
production of the engine ax satisfies the following IFT and the generalized second 
law [16] : 

=1^ (18) 

(ax) -'^{XIx,n) >0, (19) 

n 

where AIx,n ■= 7t2„+2 {x; y) — /t 2 „+i {x] y) represents the change in the mutual information 
between before and after the n-th feedback process. This IFT implies that if we consume 
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Figure 4. The choice of in the proof of the IFT for general measurement and 
feedback processes (EOl)- 


the correlation between the engine and the memory (i.e., {^^x,n) < 0), the entropy 

prodnction in the engine can be negative (i.e., (ax) < 0) np to the amonnt of the 
consnmption. In contrast, if we establish their correlation, we need the corresponding 
extra cost. Eqnality fflSj) is a special case of a more general IFT that is discussed below. 


2.4- IFT for general measurement and feedback processes 


In this subsection, we mention on the case of the general measurement and feedback 
processes with bipartite systems, which is applicable for example to autonomous 
information processing in biological systems umiH]. The transition rate of X depends on 
the state of memory Y, and vice versa, although the time-separation of the measurement 
and feedback [Eqs. ffTbjl and ffT7|) ] is not assumed. 

We dehne the entropy production associated only with X by the same form as 
Eq. ([13]). By applying Eq. (ITT]) with setting all transitions in X as fl (see Fig. H]), it has 
been shown that the following IFT holds [M] : 

(^e-^x+Aix^ = 1 , ( 20 ) 

where AIx represents the change in the mutual information contributed from X [261 - 
[281132] dehned as 

A/x :=/xjump + / Fx{x{t),y{t),t)dt. (21) 

^ 0 

The hrst term /xjump represents the change in the mutual information with realized 
jumps of X dehned as 


N 

Ixjump •= {Itiixi, yi) — Iti{xi-i^ yi-i)) ( 22 ) 

i=l 

where 6 is the Kronecker delta. Here, we used notation Wi =: {xi^yf). The second term 
involves a time integral over the entire time interval; its integrand Fx{x, y, t) represents 
the change in the mutual information induced by the probability hux of X, which is 
dehned as 


1 

P{x,y,t) 


Jx{x,y,t) 


1 

P{x,t) 


Fx{x,y,t) : 


Jx{x,t), 


(23) 




















Role of measurement-feedback separation in autonomous Maxwell’s demons 


Dense Dilute 

y=l ^ 
wall 



It 


4 




x=p 


x=a 




e=0 



li-'C 

it 

It 


l^-l[ 


: mt 


Figure 5. (a): The state space of the 4-state model. If a particle is (is not) in the 
site, the wall tends to move right (left), (b); The state space of the 8-state model. For 
e = 1(0), only the state of the wall (the particle) can change. The additional variable 
e also changes stochastically. 


where Jx{x,t) ■-= Jfy Jx{x,y,t). 

3. Autonomous Maxwell’s demon with separated measurement and 
feedback process 

In contrast to the IFT for the Szilard-type demons (1T8|1 . the IFT for general measurement 
and feedback fl20D includes a time-integral term over the entire time interval. The 
most important difference between these setups is whether the time interval of the 
measurement phase and the feedback phase are separated externally. Although 
autonomous systems are not controlled externally, two phases can be separated even in 
autonomous systems by introducing an additional stochastic variable which determines 
whether the present state is in the measurement phase or in the feedback phase. To 
clarify this point, we construct an autonomous model with separated measurement and 
feedback phases, and derive an IFT satished in this system. 

3.1. Model and setups 

Let us start from simple models with and without measurement-feedback separation. 
We hrst consider the autonomous 4-state model introduced in Ref. [3l], where the 
measurement phase and the feedback phase are not separated. The 4-state model is 
a bipartite system which transports particles from a dense particle bath L to a dilute 
particle bath R (see Fig. [5](a)). There is a site between two baths with at most one 
particle, where x G {p, a} represents the presence p or the absence a of a particle at the 
site. We then introduce a wall which prohibits jumps of particles. If the wall is between 
the site and bath L (R), we denote the state of the wall as y = I (r). The position of 
the wall tends to be r (/) if a particle exists (does not exist) at the site. With these 
processes, particles are transported against the chemical potential gradient. 

Now we construct an autonomous model named the 8-state model with the 
measurement-feedback separation, by adding a new stochastic variable e G {0,1} to 
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the 4-state model (see Fig. 151(b)). The role of e is to determine whether the present 
state is in the measurement phase or the feedback phase. When e = 0 (1), only 
particles (the wall) can move and the wall (particles) is hxed, which corresponds to 
the feedback (measurement) phase. Since the probability distributions and transition 
rates are independent of time, we omit the argument of t. These conditions are written 
as P{1 —)■ r; x, 0) = P(r —>■ 1; x, 0) = 0, P{p —)■ a; y, 1) = P{a —)■ p; y, 1) = 0. We assume 
that the transition rates of e are independent of x and y, and write Pqi := -P(0 —)■ 1; x, y) 
and Pio = P(1 —!■ 0; x, y). 

We can easily generalize this setup to the case with more than eight states. Suppose 
a composite system with three variables; x, y, and an additional variable e G {0,1}, 
which is in the stationary distribution with time-independent transition rates. We 
assume that only one of {x, y, e} changes within a single transition. The transition 
rates also satisfy the following conditions (see also Fig. |6](a)): 

P{e ^ e']x,y) = Pee', (24) 

Pix^x';y,l) = 0, (25) 

Piy^y';x,0)=0. (26) 


3.2. IFT for separated autonomous demons 

We now discuss an IFT for autonomous demons with separated measurement and 
feedback (e.g., the 8-state model). The entropy production of engine X is dehned 
as 


ax —fdQx + ^sx 

N 

■ ^ ) Q(^i—1) Vi—l, ^i—1 t Xj, J/j, ej)(fy^_j^ yhei_i,ei T s(xjv) s(Xq). (27) 

i=l 

By using the stationary distribution Pss(x) := f dydePss{x,y,e), we dehned the 
stochastic entropy of x as s(x) := — In Pss(x). Under the setup described in Sec. 13.1( ax 
satishes the following IFT: 


^^-^x+'f2lifi+P(xN-,yN)-Pixo-,yo)'j _ 
Here, Jg^ is dehned as 

^0,i ■ Ij 2/i—1 l^i—l) (^ei_i,0 ^ei,o)) 


(28) 

(29) 


which subtracts (adds) the mutual information at e = 1 (0) when the state changes 
from the measurement (feedback) phase e = 1 (0) to the feedback (measurement) phase 
e = 0 (1). The conditional mutual information is dehned as 


I{x]y\e) 


P,,{x,y\e) 

Pss(x|e)Pss(p|e)’ 


(30) 


where Pss(x|e) := / dyPss{x,y,e)/Pss{e). The dehnition of AIx,n in Eq- HTH]) is regarded 
as the change in the mutual information between the endpoint of the measurement 
processes and the endpoint of the feedback processes. P{x;y) is dehned as P{x;y) : = 
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Figure 6. (a): The state space of a system which satisfies the setup in Sec. 13.11 For 
e = 1, only y can change, and for e = 0, only x can change, (b): The same state space 
seen along y axis. Since x does not change for e = 1, Pss(a^|l) = llis(a;|0) = Pss[x) 
holds in stationary state. 

/(x; t/|e)(5e,o, which counts the mutual information at the initial and the hnal states if 
these states are in e = 0. 

We now derive Eq. (j28|l from Eq. (1TT]1 by setting to {(a:', t/', e') —)■ (x, t/, e)|e = 0} 
(see also Fig. [7]). In this case, since the system is in the stationary state, Asq is 
calculated as 

N 

Asq ^ ( ^(Xj—i, t/i—i, Cj—i) (5ei_i,0 ^ei,o) 
i=l 

+ un, e7v)(5ejv,o “ s(xo. Ho, eo)6eofl, (31) 

where we used Jo(x,?/,e) = 0 for all (x,t/,e). The difference between Qq and Qx is 
equal to the heat absorption accompanying the transitions from e = 1 to e = 0: 

^ P fll 

(dQn - fdQx = X! p'"(o)'^ei- 0 ^ei_i,l 

N 

= ^ In Fss(ej_i)(5ei,0 — + In Pss(0)(5eo,0 — '^ejv.o), (32) 

i=l 

where we used the stationary condition for e such that Pss(0)Poi = -Pgs(l)Pio. Since y 
is hxed while e = 0 and x is hxed while e = 1, it is easy to show that 


N 


Y, (s(Xi_i) + s(2/i_i)) - 4i,o) 

i=l 

s(x7v)(^ejv,l s(xo)^eo,l T 'S(2/o)*^eo,0- 


(33) 

We also note that 


Pss(x|l) = Pss(a;|0) = Pss(x) 

(34) 

Pss(|/|l) = Pss(l/|0) = Pss(|/) 

(35) 


for all X, y (see Fig. [6](b)), which follows from the fact that Pqi and Pio are constant and 
independent of {x,y). Finally, we arrive at 

N 

- /3Qn + Vi-i, Ci-i) - s(xi_i) - s{yi_i) - s(ei_i)) {Sei_i,o - ^ei,o) 

i=l 


= 
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Figure 7. The choice of fl in the proof of Eq. (l28l) . Transitions —>■ 

{x, y, e)|e = 0} are set as 12, which are colored by red. 

+ {s{xn, Vn, Cat) - s(t/Ar) + In P(0))(5e^,o + s(a:7v)(5ejv,i 
- (s(a;o, t/o, eo) - s{yo) + In P(0))5eo,o - s(a;o)5eo,i 

N 

= - fdQx + s{xn) - s{xo) Vn) + /°(xo; yo), (36) 

i=l 

which implies Eq. fl28|) . 

3.3. State-space reduction of autonomous demon 

In this subsection, we show that the IFT for non-separated autonomous demons 0201) 
in stationary states can be naturally derived from the IFT for separated autonomous 
demons (l28l) . by considering the reduction of the variable e. Suppose that there are 
two models, A and B. Model A has three variables {x,y,e), and satishes the setup 
described in Sec. 13.11 Model B has two variables {x, y), and satishes the setup described 
in Sec. 12.41 Hence, Eq. fl28|l holds in model A and Eq. fl20|) holds in model B. In 
the following, superscript A (P) represents quantities in model A (P). By using the 
transition rates of model A, we set the transition rates of model P to 

P^{x ^ x'; y) = Pi(0)P^(x ^ x'; y, 0), (37) 

pB^y ^ = P^^(l)P^(^ ^ y'- X, 1). (38) 

Here, we introduce a quantity k: 

k ■.= P„Pi(0) = (39) 

which characterizes the typical rate of the transition in e. By taking the limit k ^ oo 
in model A with hxed P^(x —)■ x';?/,e), P^{y —>■ y';x,e), Ps^(O), and P^{1), we obtain 
a reduced Markovian dynamics with the variables {x,y), which is equivalent to the 
dynamics of model P. 

Now we compare Eq. (1281) for model A in the limit fc —)■ cx) and Eq. (|2ni) for model 
P. For sufficiently large k, the number of back-and-forth transitions between e = 0 and 
e = 1 is fc + 0{'/k) per unit time, where the second term represents the huctuation. 
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Figure 8. In the setup of Sec. 13.11 we take the limit that e changes quickly, and obtain 
the reduced model with two variables x and y. 


Then, the total count of per unit time during the stay at is calculated as 

[k + 0{y/k)) (/^(a:“,/|0) -/^(a:“,/|l)) 

^ E.C P^ijxf y\ ^)P\x^ ^ X--y\ 0) - P^,{x\ y\ ^)P\x- ^ y\ 0) M ^ 

P^i{x'^,y^\l) \y/k, 

^ Sxc Pf^jxf y'’)P^{x^ x°; y^) - Pf^jx'^, y^)P^{x^ x^- y^) (J_\ 

\Vk) 

^ Jx(^p\y!l^n ( 

\Vk) 


= Fx{x\y\t) + 0 


.Vk, 


In the second line, we used Eq. fl3T|) . In the third and hfth lines, we used 

/|e) = /) + O (1) = (a:“, /) + O (1) , 

for e = 0,1. In the fourth line, we used the stationary condition at (x“, y^, 0): 


(40) 


(41) 


Fi(0) ' PHI) 

E (i^t yt 0)P^(x‘ ^ x"; y\ 0) - PHx‘, y\ a)P-'(x‘ ^ x'; y\ 0)) . 


(42) 


In the last line, we used the fact that the second term of the rhs of Eq. i izdll is zero m 
the stationary state due to 


Jx(x,t) = = 0- 


(43) 


From (HOj) . it is straightforward to hnd that Eq. fl20|) for model B is equivalent to 
Eq. (125]) for model A in the limit fc —)■ cx). This result indicates that the time-integral 
term in Eq. fl20|) appears due to the measurement phase and the feedback phase being 
unseparated in the setup of Sec. 12.41 
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Figure 9. An example of the division of the state space. The subset of states D is 
We set the ten red arrows to in this case. 


4. Role of separated measurement and feedback in IFTs 

We discussed in the previous section that the IFT fl28D satished in our separated 
autonomous demon model is similar to that of the Szilard-type systems fflSll . In contrast, 
the IFT fl20|) for the general measurement and feedback systems contained a time- 
integral term Fx{x,y,t), which we found an interpretation as the mutual information 
flow in the fast switching limit as shown in Eq. (I40|) . We here aim to clarify the 
relation between the existence of the time-integral term in the IFT and the separation 
of measurement and feedback dynamics. 

Let us first recall how we set when we derived the IFTs, from the viewpoint of the 
general framework in Sec. 12.21 First, we define a set of transitions whose final state is w 
as S'u, := {(w' —)■ w)\w' G W, {w' w) E G}, where W represents the set of all possible 
states and G represents the set of all possible transitions. Then, the common feature of 
the choices of for Eq. flTSll and Eq. fl28ll is that Sw satisfies Sw F fl or Sw F for 
any w. In the case of Eq. flTSl) . is time-dependent, and all satisfy Ffl in 

the feedback (measurement) phase (see Fig. [3]). In the case of Eq. (]28ll . for w with e = 0 
(e = 1), Sw satisfies S^, F Q (fl^) (see Fig. [7]). This property implies the separation of 
the measurement phase and the feedback phase. We call this condition the separation 
condition. Conversely, the measurement phase and the feedback phase are unseparated, 
when we can And some {w,w',w'') such that (w' -E- w) E Q and {w" -E w) E (see 
Fig. 0]), as in the case of the general measurement and feedback setup including the 
reduced dynamics discussed in Sec. 13.31 

To confirm that the separation condition plays a crucial role for the time-integral 
term in IFT, we show another IFT for the division in a state space. Corresponding to 
a subset with separation condition, we divide the possible states into two groups (see 
Fig. [9]): 


D := C 
:= {w\Sw C 


(44) 

(45) 


Owing to the separation condition, is indeed the complement of D. Although D is 
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time-dependent in general, in the following we assume that D is time-independent for 
simplicity. We now show that can be transformed into a form without any time- 
integral term. By focusing on the change in the stochastic Shannon entropy, Eq. (171), 
the integrand of the time-integral term can be written as 


Jno{w,t) 

P{w,t) 


d 

— In P(w,t) w e D 

dt ^ ^ 

0 otherwise. 


(46) 


which is the crucial property of the separation condition. Adding the contribution from 
the jumps, we have 

/■'T Jn{w,t) 


Aso = sn,. 


jump 


P{w,f) 


N N 

= ti) - s(Wi_i, ti))5D{Wi) + ^i+l) “ U))dD{Wi) 

i=l 

N 

= H + sd{wn, T) - sd{wo, 0). (47) 

i=l 

where 5j:){w) takes 1 if tn G H, and 0 otherwise. Note that 5^{w' w) = doiw) holds 
for with the separation condition. We also introduced the entropy exchange between 
D and through the Ath transition 



■ 5(^4 — 1 ) tf) 
s('U)j_i, tf) 

0 


and the entropy associated with D: 


Wi-i e D, Wi ^ D 
Wi-i ^ D,Wi e D 
otherwise. 


(48) 


SD{w,t) := s{w,t)6D{w). (49) 

The entropy exchange represents the initial and the hnal entropy of the dynamics 
in D, which corresponds to Jg^ in Eq. (1281) . Therefore, the IFT for the case of divided 
states does not include the time-integral term. We note that the contribution from 
the entropy exchange in Eq. (1471) corresponds to the change in the mutual information, 
which appeared in the IFTs for Szilard-type systems and the model with separated 
measurement and feedback phases. 


5. Conclusion 

In this paper, we clarihed the difference between the Szilard-type demons and 
autonomous bipartite demons. By introducing another type of autonomous demon, 
in which the measurement phase and the feedback phase are separated, we showed that 
the presence of a time-integral term in IFTs is related to the unseparated measurement 
and feedback phases. Since the Szilard-type demons and the 8-state model have the 
separated measurement and feedback phases, the IFTs for the Szilard engine type 
demons [Eq. (ITSD ] and for the 8-state model [Eq. (128|) ] do not contain any time- 
integral term. In contrast, since the autonomous bipartite demons have the unseparated 
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measurement and feedback phases, the IFT for the autonomous bipartite demons 
[Eq. fl20|) ] contains a time-integral term. 

On the basis of the general framework in Sec. 12.21 we clarihed the concept of 
separation as the condition on the choice of the subset of transitions O. The separation 
condition leads to the absence of time-integral terms, which is clearly shown in Eq. (07]). 
Understanding the separation of the measurement phase and the feedback phase is 
important to analyze the difference between ideal information processing systems (e.g., 
the Szilard engine) and demons in the real world such as biochemical networks. 
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